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Abstract. The success of Berry phases in quantum mechanics stimulated the 
study of similar phenomena in other areas of physics, including the theory of 
living cell locomotion and motion of patterns in nonlinear media. More recently, 
geometric phases have been applied to systems operating in a strongly stochastic 
environment, such as molecular motors. We discuss such geometric effects in 
purely classical dissipative stochastic systems and their role in the theory of the 
stochastic pump effect (SPE). 
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1. Introduction 

The discovery of the Berry phase [1] revolutionized the study of many quantum 
mechanical phenomena. To explain this discovery, consider a quantum system with 
a Hamiltonian i?(k), where k — k(i) represents a vector of control parameters that 
can change with time along a prescribed path. The state of the quantum system is 
described by a complex valued wave function . However, the physical state itself 
only determines its wave function up to a phase because the wave functions ^' and 
e*<^\|/ define the same physical state. We assume that, initially, the wave function is in 
one of the nondegenerate eigenstates of the Hamiltonian -ff(k). 

If the control parameters k change with time adiabatically slowly, then the 
Hamiltonian is explicitly time dependent but the adiabatic theorem of quantum 
mechanics [2] guarantees that the wave function will remain an instantaneous 
eigenstate of the Hamiltonian i/(k(t)) during the evolution. Assume also that control 
parameters are changing along a closed countour in the parameter space, so that at 
the end of the evolution they return to the initial values, as in Fig. [T] According to 
the adiabatic theorem, after completing the cycle, the physical state of the system 
should coincide with the initial one. This theorem, does not mean that the phase of 
the wave function returns to the initial value. Careful examination shows |T] that the 
phase picked up after a cyclic evolution can be written as a sum of two components 

4> ^ 4>dyn + 4'B, (1) 

where the dynamic phase cjjdyn = ~ Jq E{t)dt appears even when parameters are fixed, 
T is time of cyclic evolution, E{t) is energy detemined as the instantaneous eigenvalue 
of the Hamiltonian H{k{t)), and we assume that = 1. The second contribution in ([l]) 
is called the Berry phase. It has no stationary counterpart and is purely geometrical, 
in the sense that it depends only on the choice of the Hamiltonian and on the path 
in the parameter space. In particular, it does not depend explicitly on time of the 
evolution T or on the rate of motion along the contour. Given the dependence of the 
eigenstate \u) of the Hamiltonian on k in some gauge, the Berry phase is given by 

(j)B=<j)A-k, A={u\idi,u), (2) 

where c is the contour in the space of control parameters, and A is called the Berry 
connection (see David J. Griffiths f3l for a pedagogical derivation). The cyclic Berry 




Figure 1. A closed contour in a control parameter space. 

phase is gauge invariant and has measurable effects, which have been confirmed 
experimentally. 
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Berry's discovery has a rich prehistory. As Berry himself pointed out |4,J , a number 
of effects in quantum mechanics had been related to the unusual phase evolution of 
the wave function even before the Berry's discovery [T]. Other historical antecedents 
can be found, for example, in the first efforts to create a semiclassical theory of the 
anomalous Hall effect [311]. However, it was Berry's work that unified all these known 
geometric effects under a universal theoretical framework. This framework has proved 
very useful in uncovering new effects and has provided the theoretical groundwork 
for entire branches of physics such as topological quantum computations [TT], the 
quantum theory of polarization |10j and the theories behind various extraordinary 
Hall effects [71IH1[1]. 

The Berry phase is an example of the anholonomy effect encountered in the theory 
of differential equations. Anholonomy can be non-rigorously defined as failure of 
vectors return to their initial values after a parallel transport along a closed contour. 

Since there are both quantum mechanical and classical mechanical antecedents 
of the geometric phase, it is natural to ask whether there are also antecedents in 
stochastic processes. Here, we should point out that there is a fundamental difference 
from quantum mechanics, which prevents direct analogies. While the state of a 
quantum system defines the wave function only up to an overall phase, a classical 
ergodic stochastic system can be described by a probability vector, without allowing 
any additional freedom in its definition. For example, consider a Markov process, i.e a 
stochastic process whose future evolution depends only on the present state but does 
not depend on the past. The evolution of the probability vector satisfies equations 
which are reminiscent of the quantum mechanical evolution. Fig. |2] shows the simple 
example of a 2-state quantum system and its stochastic counterpart. In both cases the 
evolution is described by linear differential equations with 2x2 evolution matrices. In 
the quantum mechanical case, the amplitudes ui and U2 of two states evolve according 
to the Schrodinger equation 

ui\_( ei(i) A(t) \(ui 
'dt \u2 ) \ A*it) e^it) J{u2 

while the continuous 2-state Markov process, with probabilities pi and p2 of the first 
and the second states, is defined by differential system [T2] 

d_ / Pi \ / ^k,{t) k_,{t) \ f p, 
dt\P2 ) \ ki{t) -k-i{t) )\p2 

where parameters ki and fc_i are called kinetic rates. They describe how often a 
system jumps from one state into the other. In spite of the similarity of Eqs. ([3| 

A ki. ^ 

(a) (b) 

Figure 2. Two-state systems: (a) quantum (b) stochastic. 

and it is well known that a quantum mechanical, cyclically driven 2-state system 
can have a nontrivial geometric Berry phase, but that is not true for its stochastic 
counterpart. For given values of parameters, an ergodic Markov chain has a unique 
steady state. Under slow evolution of parameters, the probability vector will simply 



I- 



(3) 



(4) 
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follow the path of instantaneous steady state values, returning to the initial vector 
after the parameters complete a full cycle. 

This example shows that, in an obvious sense, the Markov process does not lead to 
adiabatic geometric phases. However, this conclusion is restricted only to the evolution 
of the probability vector for a present state. There are other characteristics describing 
stochastic processes. For example, one can consider stochastic transitions among 3 
states in Fig. |3] and ask what is the probability that the system makes exactly n full 
cycles in a clockwise direction by the given time t. In the following sections, we will 
derive the evolution equations for similar quantities and show that geometric phases 
do play an important role in their evolution. 




Figure 3. A 3-state Markov chain. Tiiis model can be considered as a minimal 
model to describe the stochastic behavior of a molecular motor in Fig. |12| 

Anholonomies also play a central role in classical thermodynamics. The 
Carnot cycle is an example of a thermodynamic process exhibiting anholonomy |13j . 
Statistical properties of a system in thermodynamic equilibrium can be specified by 
a set of parameters, such as the volume, the pressure and the temperature. Slow 
cyclic changes of these parameters merely produce cyclic changes of the equilibrium 
properties, so, as in the example of a 2-state Markov chain, a driven system returns 
to the initial state in a statistical sense by the end of a cycle. However, if one looks at 
the same process from a more general point of view, namely including effects of this 
process not only on the given system, but also on systems in contact with it, a cyclic 
adiabatic evolution of control parameters usually does not lead to the same finite state 
in the full phase space. The laws of thermodynamics predict that the system converts 
part of the absorbed energy into production of the work. Moreover, for adiabatically 
slow evolution, the work produced depends only on the choice of the contour in the 
parameter space, but depends neither on the rate of motion nor on the mechanism of 
coupling to the environment. This means that the work can be expressed as a contour 
integral over the path in the space of control parameters. For example, for a gas in a 
reservoir with variable volume V and temperature T, the work W produced per cycle 
is 

W ^ I p{T, V) ■ dV, (5) 

Jc{T,V} 

where p{T, V) is the pressure. 

The property of dynamic systems to change their state in response to a periodic 
perturbation with zero bias has been widely used in control theory I14J. Look e.g. at 
the simple input/output model described by differential equations 

i' = /;(x)u,(i), (6) 
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where fj are smooth functions of x, and Uj{t) represent control parameters. One can 
consider a simple periodic evolution in the control parameter space by setting Ui — 5i i 
during an infinitesimal time interval t, where 5ij is 1 when i = j and otherwise. 
After this, one sets Ui = 6i,2 during the following time interval {t,2t), then takes 
Ui = —di^i for (2t, 3t), and finishes with Ui — during (3i,4t). 




Figure 4. Trajectory of x in response to a periodic infinitesimal path in the 
space of control parameters \ui\. 

An easy perturbative calculation shows that, after one such an infinitesimal 
evolution in the space of control parameters with zero bias, the vector x does not 
generally return to the initial state but rather acquires an additional correction, namely 

x(4i) -xo + iMfi,f2](xo)+0(t3), (7) 

where the operation [fi, £2]* = {fidfydx^) — {f2dfl/dx^) is called the Lie brackets of 
the vector fields fi and ¥2- In general, the the value at Xq of the Lie bracket [fi,f2] can 
even be linearly independent of fi(xo) and f2(xo). This phenomenon is exploited in 
Chow's theorem which, together with the theorem of Frobenius, describes the space 
of configurations that can be reached using only a prescribed set of vector fields to get 
around [15|. 

Although the history of anholonomy effects reaches at least as far back as the 
19th century, a complete survey of its development is beyond the scope of this article 
and we will not pursue it further. Instead, we will concentrate on applications of 
geometric phases to stochastic and dissipative processes. These topics have attracted 
attention relatively recently due, in part, to the success of the Berry phase in quantum 
mechanics. We attempted to make the review accessible to an audience not familiar 
with the mathematical theory of fiber bundles. This review is also not about the large 
body of work related to decoherence effects on quantum mechanical Berry phases or 
on geometric phases in chaotic non-dissipative systems. The reader should consult 
(H Uni [TTl UHl HH] for an introduction to these topics. 

The structure of this review is as follows. Section 2 reviews extensions of 
the Berry phase idea to non-unitary evolution. Section 3 describes the theory and 
applications of geometric phases in dissipative systems with a continuous symmetry 
of steady state solutions. One important application is to control of pattern motion 
in nonlinear media. Section 4 briefiy reviews the geometric theory of locomotion of 
micro-organisms. In section 5, we introduce the stochastic pump effect and its relation 
to geometric phases in the evolution of the moment generating functions. In section 6, 
we generalize the concept of the geometric phase in stochastic processes to noncyclic 
evolutions. In section 7, we explain how geometric phases can influence the kinetics of 
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slow variables in a coarse-grained description of a stochastic process with a hierarchy 
of important time scales. This is regarded as a stochastic analog of the quantum 
mechanical Born-Oppenheimer approximation. We also study stochastic analogs of 
Berry phases from this point of view. The reader who is not interested in complicated 
mathematical details might prefer to skip section 7 on a first reading. In section 8, 
we review the geometric phases in the "limit cycle" evolution. Section 9 is about 
constraints that detailed balance conditions impose on geometric effects in systems 
near thermodynamic equilibrium. In section 10, we apply some of the techniques we 
have discussed to the theory of molecular motor operations. In section 11, we outline 
several directions for possible future research. 



2. Geometric phases in non-unitary evolution 

Non-unitary evolution is often considered in quantum mechanical problems, where 
the coupling to the environment is described phenomenologically by introducing extra 
parameters in the equations of motion for a density matrix or a wave function. In 
many physical problems one can encounter evolution equations, similar to quantum 
mechanical ones but with a non-Hermitian operator replacing the Hamiltonian. 
Examples can be found in electronic circuits [50], optics [H], acoustics [H]. The 
evolution of any dissipative system near a stable point or a limit cycle can be linearized 
and assume a form similar to the quantum mechanical Schrodinger equation for a state 
vector. Motivated by the success of the quantum mechanical Berry phase, several 
studies [231 EH 123 ES] were devoted to geometric phases in systems with non-Hermitian 
Hamiltonians. The models considered could generally be written in the form 

j^\u)=H{]^)\u), (8) 

where H is arbitrary N x N matrix, and \u) is an A^-vector. 

Imitating the derivation of the quantum mechanical Berry phase in the adiabatic 
limit leads one to a similar result: if the vector \u) at the initial moment of the 
evolution is one of the eigenstates of the matrix H(k), i.e. if 

H\u{0))^e\um, (9) 

then after a slow cyclic evolution of parameters, the vector \u) generally returns to 
the initial one up to a factor 

\u{T)) = e-^cA-<ikg/„^dte(t)|y(o)), (10) 
which can be separated into dynamic and geometric parts. Strictly speaking, the 



values in the exponents in (10 1 are not phases because they are no longer purely 
imaginary. However, it is generally accepted to use the term, "phase", because of 
the strong analogy with quantum mechanical phases. Berry |25j pointed that it is 
convenient to express the geometric phase by introducing also the left-eigenstates of 
the Hamiltonian -ff(k), such that 

{u\H ^ {u\e. (11) 

The eigenvalues for left and right eigenvectors coincide. For a non-Hermitian 
Hamiltonian, the eigenvalues are no longer real and the components of the left 
eigenvector are no longer complex conjugates of the right eigenvector. In other 
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respects, there is a strong similarity with quantum mechanical Berry phases, e.g. 
the connection A can be written as 

A=<^. (12) 

{u\u) 

Non-unitary evolution does not necessarily describes a dissipation. The geometric 
phases with a non-Hermitian Hamiltonian that realizes transformations of the group 
SU{1, 1) (i.e. transformations that preserve the form — Izfj of a complex valued 
2- vector (2:1,22)), have attracted considerable attention because of their applications 
to squeezed states [571 [251 [251 [50] , and a number of models in classical mechanics and 
optics |3TJ [32135]. The group SU{1, 1) is a covering group of the 3-D Lorentz group. 
The corresponding geometric phase is responsible for a variety of relativistic effects, 
such as Thomas precession [531 [3i] • We refer the interested reader to the review [35] . 
More important for our subject is that the group SU{1, 1) is isomorphic to the group 
SL{2, i?) of 2 X 2 matrices with real entries and the unit determinant. The SL{2, R) 
evolution can be used to describe a classical dissipative system. Corresponding 
geometric phases were studied both theoretically and experimentally in connection 
with light propagation through a set of polarizers [ST] [381 131] . Recently, the relation 
of this geometric phase to the stochastic pump effect was discussed in [10] . 



The geometric phase in Eq. ( 10 1 was generalized to nonabelian and non-adiabatic 
evolutions [5HII1I] and a number of applications were proposed, e.g. to optically active 
refracting media |25j . One interesting property of non-Hermitian Hamiltonians, not 
found in quantum mechanics, is the possibility of so-called exceptional points in the 
spectrum. If a contour encloses such points, the eigenvalues of the Hamiltonian are 
not single valued along this contour. A simple example is the following 2x2 matrix, 
which depends on a complex parameter z and which has as an exceptional point: 



1 

z 



zeC-{0}. 



Its eigenvalues X± = ±y/z are double valued functions on the space — {0}. 
Encircling such points, the eigenvectors acquire a geometric phase of a new type which 
has been studied theoretically in [J^l [351 [331 135] and observed in experiments [3S1 137] • 
In spite of this progress, one might think that the geometric phase in dissipative 



evolution would be insignificant in comparison with the dynamic part in ( 10 1 on the 
grounds that the latter becomes either exponentially large or exponentially small with 
time. However, not all modes in dissipative evolution grow or decay exponentially 
since the matrix H might also have zero modes, i.e. one or several linearly independent 



states with a zero eigenvalue. If all other modes decay quickly, according to (10 1, the 
evolution of such a dissipative system in the adiabatic limit should instead be governed 
by the geometric phases. More generally, geometric phases can also be important 
when, for fixed values of parameters, a system relaxes to a limit cycle. In that case, 
the corresponding eigenvalue is purely imaginary. 



3. Control over pattern position and orientation 

In early 1990s, Landsberg [48l [49|, and independently Ning and Haken [50l [51], 
suggested that geometric phases should generally appear in many classical systems 
which can be described by a set of nonlinear differential equations with a one- 
parameter group of symmetry transformations. In such a system, it is possible to 
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reduce the evolution equations to a form in which one of the variables does not affect 
the evolution of the others, that is 

"J^n^.X, f = H,Y,. ,13) 

where O and the vector Y represent generalized coordinates of the system while F 
and H are nonlinear functions of the coordinate vector Y, but not of Q. Assume that 
the system is initially at the steady state and that the parameter vector A changes 
slowly with time. Landsberg considered the case when the evolution of the variable 
Y is dissipative, so that if parameters A are time-independent, Y relaxes to a steady 
state value Y*(A). In that case, for adiabatically slow evolution of A, Y simply follows 
a quasi-steady state trajectory up to a small non-adiabatic correction 

Y{t)f=iY*+D¥-^{Y*)dtY\ (14) 

where DF — (9F/5Y)y^y' ^^"^ linearization of the vector function F, and DY^^ 
is the inverse of the linear function Z5F. However, one should not assume that G 
can be uniquely determined by given values of the control parameters. Due to the 



symmetry Q ^ Q + 56 oi Eq. (13 1, where 56 is arbitrary constant, the steady state 
value of is not specified. Hence Q does not have to return to its initial value 
after the parameters A complete a full cycle. Landsberg showed in [49 that, after a 
cyclic evolution, the variable changes by an amount given by a trivial dynamic part 
A0dyn = / dtH{Y* {€)) plus a geometric contribution 

AGgeom - A • dA, A = DH{Y*)DF-\Y*)dxY*, (15) 

where DH = 9i7/9Y|Y=Y* is the linearization of the function H near the point Y*. 

Suppose, that instead of a vector Y with discrete set of entries, we deal with 
continuous systems. The vector index then becomes a continuous coordinate and 



Y is a function of this coordinate. To generalize (151 to such continuous systems, 
Landsberg considered equations of the form 

'^^^^F{x,\)^'{t,x), (16) 

where F is now a nonlinear operator, which depends on time only through time- 



dependent control parameters A, and where the evolution equation (16) is assumed 
to be invariant under a continuous group G of symmetries, such as the group of 
translations in the direction of the coordinate x. 



Let \4'{x)) be a stationary pattern profile, i.e. a time-independent solution of ( 16 1 
for constant A. Let DF be the differential operator, which is the linearization of the 
operator F near the solution |V'(2^)), and let {vo\ be the zero mode of the differential 
operator DF^, which is the conjugated differential operator to DF, in the sense that 
/ g{Df) = J {D^g)f. Landsberg showed that after a cyclic evolution in the parameter 
space, the stationary pattern will change by a geometric shift A6gcom, given by 

(wolxV') 

along the symmetry direction, where x is the generator of transformations of the 
symmetry group G. 



AGgeon. = M . dA, A = -^;^^, (17) 



Eq. (17 1 can be illustrated by a following simple example [52]|53]. Consider a 
ID ferromagnetic wire with a strong hard axis along it, which favors a magnetization 
direction transverse to the wire, as shown in Fig. [5] Assume that a fixed set of 
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Figure 5. The wire with a hard anisotropy axis along it and a domain 
wall between two opposing magnetization directions. Easy axis anisotropy is 
perpendicular to the x-direction, and makes an angle i^o with a j/-axis. Red 
vectors show the direction of the local magnetization. 



rectangular coordinate axes has been chosen, with the x-axis along the wire. We also 
assume the presence of a weak transverse anisotropy, so that the magnetization energy 
is described by the energy functional 

j dx{J{dipldxf + KsiT?{ip- Lpo)}, (18) 

where ip is the magnetization angle with the y-axis, and the parameter Lp^ is the angle 
that the transverse anisotropy axis makes with y-axis (Fig. [s]). 

In the limit of strong dissipation, the evolution of the variable p{x^ t) is given by 

5E 

adtip = - ^ = 2Jdlip - Ksm[2{ip - ipo)l (19) 
dip 



where a is a damping constant. Note that Eq. (19 1 is invariant under the translation 
X ^ X — 5x, which justifies the use of the geometric theory of |3H]. The generator of 
this symmetry is x = —dx- 



At equilibrium, the ground state of (18) is doubly degenerate at ip = po and 



p — Pq + n. Consider the stationary solution of ( 19 1 describing a domain wall 
connecting these two states 

(p'^''(x;(^o,xo) = ^o + 2tan-ie(^-^°)/^,A= v/j/Ko, (20) 

where Xq and A can be called respectively the position and the size of the domain 
wall. Assume that the parameter pq is slowly time-dependent and varies from to 2tt 
as the transverse anisotropy axis performs one rotation around the x-direction. One 
can realize this situation, for example, by physically rotating a wire. In our model. 



Po is the control parameter, and Eq. (17 1 gives 



j; fr^dx[vo{x)d^,p''-{x)] 

- f nd.bo(.)a.v.-(x)] 

where vo{x), given by 

Vo{x) = ^ (22) 

cosh {{X — xo)/ A) 

is the zero mode of the self-adjoint operator 

DF = DF+ = 2Jdl - 2Kcos[2((/3^"(x; po, xq) - Po)]- (23) 



Substituting this value of vo{x) into (21 1 we find 



Sxn = / A^^dpo, = 7rA/2, (24) 







which was derived in [S3] using the secular perturbation theory. 

A number of theoretical and experimental studies of the motion of domain 
walls in liquid crystals under the influence of periodic perturbations have been 
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performed [52l [54l |55j |56l [57], but the role of the geometric phase has not been 
discussed. Landsberg's theory was aimed at control of wave patterns in nonlinear 
media. Such control was discussed in more detail for specific applications to nonlinear 
chemical reactions |58j . nonlinear optics |59j , hydrodynamics '60] and semiconductor 
microresonators [HI] • Optical applications proposed by Ning and Haken were extended 
by Toronov and Derbov [62l [63! . 

Studies of special problems with a mathematical structure similar to the 
Landsberg-Ning-Haken formalism can be found even prior to Refs. |1H1 [IH]- For 
example, the use of a rotating electric field was suggested as a means of separating 
chiral molecules in solution [BH [BS] . Recently this idea was extended to the gaseous 
state, but the proposed effect is expected to be observed in the non-adiabatic regime 
[66] . Geometric phases can also contribute to the anomalous shift of the trajectory 
of a magnetic bubble in a rotating nonuniform magnetic field, which is called the 
skew- deflection effect [57] . 

Control over the motion of domain walls and other topological defects has been 
extensively studied in magnetic materials |67l 1551 [53 [ZO] . The example of the domain 
wall shown above demonstrates that the projection of dynamics on the collective 
degrees of freedom should be performed with extra care to account for possible 
geometric phase effects. For example, in the micromagnetics literature, one often 
finds that the equations of motion for the collective coordinates ^ read [59] 

- dU/dS, - + GC = 0, (25) 

where —dU/d^ is the generalized force, V is the symmetric dissipation matrix and G is 
the antisymmetric gyrotropic matrix. However, Eq. (25) can lead to problems. In the 
case of a domain wall ( 20 1 , one can attempt to work with a single collective coordinate 
representing the position of the domain wall, and to regard the angle Lp and the size of 
the domain wall A as fast variables. This choice might seem natural in view of the fact 
that translation is the only continuous symmetry in the model and should dominate 
the physics at low energies and under slow perturbations. However, in the model under 
consideration, the wall was moving because some parameters became time-dependent. 
In the static case, there are no forces on the chosen collective degrees of freedom. Thus 
Eq. (25) can acquire extra geometric terms in explicitly time dependent situations, 
and is therefore not, in itself, sufficiently general even when only slow changes of 
parameters are considered. As another word of caution, we note that the translational 
symmetries in real applications are only approximate for standard magnetic materials 
because of the presence of impurities and discreteness of the lattice. As discussed in 
|53j . this is a serious obstacle to purely geometric control over magnetic defects in 
practical applications. 



4. Self-propulsion at low Reynolds numbers 

One of the first applications of geometric phases in dissipative systems was proposed 
by Shapere and Wilczek |7U [72] in their description of locomotion of microscopic 
organisms in a viscous fiuid. This theory was based on the well known observation 
that the motion of living organisms at low Reynolds numbers is, in fact, geometrical. 
Microscopic living organisms propel themselves in a liquid by performing periodic 
changes of their shapes. These changes correspond to noncyclic motion in a larger 
space, whose points describe the shape of the body, its position and its overall 
orientation. One can choose a gauge in this phase space, i.e. a rule to determine 
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the position and the orientation of the body of any given shape with respect to a 
fixed coordinate system in the 3-dimensional space. Using such a gauge one can 
characterize the state of the body by a set of coordinates (a;,a), where a is a vector 
of shape parameters and x = (r, 0) consists of the position r and orientation cf) of the 
body. 

Body shapes are assumed to be directly controllable by the organism subject 
to certain constraints such as conservation of volume, which allow only finite and 
quasi-periodic changes of a. The body interacts with a high viscosity liquid which 
is described by the incompressible Navier-Stokes equation. This equation should be 
solved with no-slip boundary conditions at the surface of the organism to guarantee 
the absence of force and a torque on it. For slow changes of shape, these no-slip 
conditions are expressible in terms of the first partial derivatives of x with respect 
to time. In particular, they are automatically satisfied by non-moving bodies. After 
eliminating the degrees of freedom of the liquid by solving the Navier-Stokes equation, 
the equation that connects changes of x and a follows from the boundary conditions 
and has the form 



where the connection A is defined on the space of body shapes. Integration over a 
closed path c in the space of body shapes leads to the purely geometric result that 



The geometric theory of locomotion at low Reynolds numbers has found too many 
applications to summarize here. Fortunately, fairly good introductions and reviews 
are already available (721 IZH [7S] . Here we only mention that the theory was applied 
to determine optimal protocols for cell body changes [THj [771 Ell EH EO] • It was found 
that such optimal moves are similar of those observed in some organisms |76|, 179] . 
Discussions of simple illustrative models can be found in [771 HI]- An application 
of the theory for the propulsion of microscopic objects by manmade motors at low 
Reynolds numbers can be found in |82j . 

5. Stochastic pump 

A stochastic pump is a stochastic system that responds with nonzero on average 
currents to periodic perturbations [531 IHll IH51 IHSl IH7] . We will call such currents the 
pump currents. A stochastic pump resembles a quantum pump [881 1891 1901 1911 1921 193] . 
In the latter, nonzero currents appear under similar circumstances but originate from 
purely quantum mechanical effects. The stochastic pump effect (SPE) was observed 
in frequency-locked electronic turnstile devices [941 195] and in enzymatic reactions 
[56j . Recently, it was studied experimentally in transport through a conical nanopore, 
where strong pump current variations were found as a function of the relative phase 
of applied voltage signals ^7] . 

One of the simplest models of the SPE is illustrated in Fig. |6j In this model the 
central bin system B can have at most one particle inside. The bin is connected to 
the absorbing state S from the left and the absorbing state R from the right. The 
term absorbing state means here that any number of particles can enter this state or 
leave it. Kinetic rates in the model are shown in Fig. [6] If the bin is empty, then, 
with rates ki or k-2, a particle jumps into the bin either from the left or from the 
right respectively. If the bin contains a particle, transitions into the bin are forbidden 
until this particle escapes to the left or to the right, which it does, respectively, with 



dx — A(a) • da, 



(26) 
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rates fc_i and fc2. We assume that the kinetic rates are time-dependent, i.e. they are 
control parameters, and we are interested in currents of particles from one absorbing 
state into the other one. The SPE in this model has been studied in great detail 
[551 inn Unni EnH CnU ■ Even so, due to the simphcity of the kinetic scheme in Fig. [6] 
the average current can be studied analytically along with its fluctuations [10^. 



A, 




B 



Figure 6. A simple system demonstrating the stochastic pump effect (SPE). 



The model in Fig. [6] can be used to describe charge transport through a quantum 
dot in the Coulomb blockade regime 1103!, where absorbing states represent conducting 
leads, and the bin represents the quantum dot with at most one electron inside. It 
also serves as a model of molecular fluxes through an ion channel connecting two 
compartments in a living cell IHSl 1152] . 

In what follows, we will consider the realization of the model in Fig. [6] in the 
enzymatic mechanism of Michaelis-Menten type [1041 ; which is defined as the following 
chemical reaction 



E+S 



k2 

ES = 



E + P. 



(27) 



where S and P are called substrate and product, and E is an enzyme molecule. Here, 
we assume a situation with a formally infinite number (a sea) of substrate and product 
molecules but with only a single enzyme molecule. Either S or P can combine with 
the enzyme E to produce an unstable complex which we will refer to as the bound state 
of enzyme. This complex can then dissociate into either E and S or into E and P. 
These dissociated states will be referred to as the free states. Here it is important to 
note that, even if £^5* if formed from E and P (resp. E and S), it can freely dissociate 
into either E and P or into E and S. In terms of the model of Fig. [6j the free states 
are those in which the bin is empty, while the bound state is that in which the bin 
is filled. The sea of substrate molecules is represented by the S-state and the sea of 
product molecules is represented by the P-state in Fig. [6] 

We define the moment generating function for the number of transitions, n, in 
time T from ES (the bin with a particle) into E + P (the absorbing state P) by 



+00 



(28) 



where P„ is the probability of the event that, by time T, there will be n new product 
molecules created, counting the opposite process with a minus sign. S{x, T) is the 
cumulant generating function of the number of transitions, because it determines 
all cumulants of the particle fiux. For example, the mean {n(T)) and the variance 
var{n(T)) are given, respectively, by 



{n{T)) = {-^) 



dS{x,T) 



dx 



var(n(T)) = (-i)' 



d'S{x,T) 



dx^ 



.(29) 



In order to derive the evolution equation for the generating function ( 28 1 , it is 
convenient to introduce the generating functions Ue = Yl^^-oo PnEe^"^ and Use = 
J2'^=-oo ^nSEe"^^^, where PnE and PnSE are the following probabilities: PnE is the 



CONTENTS 



13 



probability that, at a given time, the system is in a free state and the number of 
product molecules created is n, and PnSE is the probability that enzyme is in a 
bound state and the number of product molecules created is also n |166j . The master 
equations for PnE and PnSE are then 

^PnE = -{kl + k^2)PnE + k^lPnSE + k2P(n-l)SE, 

(30) 

ft^nSE = -(^-1 + k2)PnSE + kiP^E + fc_2-P(ri+l)£:- 



Multiplying ( 30 I by e''^" and summing over n we find 



where 



TT( ^\ I -kl - fc_2 fc-l + ^26'^^ , .„„s 



If we set n = at an initial moment t — 0, then the initial conditions for (31 1 
are [/^(i = 0) = Pe{0), and Ussit = 0) = Pse{0), where pe{0) and pse{0) are 
probabilities that the enzyme is respectively free or in the substrate-enzyme complex. 
Also, note that Z{x,t) = UE{X:'t) + UsE{XT't)- Thus, formally, the moment generating 
function in ( [28| can be expressed as the following average of the evolution operator 

Z(x,t) = (l|f (e/o^(x,*)<i*) (33) 

where (1| = (1, 1), where |p(0)) = {pe{0) ,Pse{0)) is the vector of initial probabilities 
of enzyme states, and where T is the time-ordering operator. 



A derivation of the adiabatic approximation for ( 33 1 can be found in [100' but 
the general discussion of section 2 shows that the generating function for a slow cyclic 
evolution of parameters is an exponential of the sum of two terms: one geometric and 
one dynamic, 

Z{x) = e^«~»(^)+'^'^^"(x), (34) 

Let eo(x) be the instantaneous eigenvalue of -ff(x,t) with the larger real part, let 
K± = k±ik±2, let e±^ = e"*"^ — 1 and let K = J^m km where m = —2,-1, 1, 2. Then 
the dynamic part is given by 

T 1 '■^ 



'S'dyn(x) = / dteo{x,t) ^ J dt 







K - JK^ + 4(K+e^ + K_e„^) 



The problem of degeneracy of eigenvalues cannot appear here because the eigenvalue 
Soix^t) corresponds to the unique steady state of the system. Here, we note that the 
vector of kinetic rates k depends on t and describes a contour c in the parameter 
space. Next, denoting by | uo(x,k)) the eigenvector corresponding to £o(Xjk), the 
geometric part 5'gcom(x) is given by equation 



<5'goom(x) = - J A • dk, An = (uo(x,k)|9fc„Juo(x,k)). (36) 
There is an obvious analogy between the geometric part of the cumulant generating 



function (36 1 and the Berry phase in quantum mechanics ([2|. The geometric phase 
'S'gcoin(x) ij^ (34 1 was discovered by Sinitsyn and Nemenman in |100j . 
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If parameters ki and fc_2 are time dependent, while k2 and fc_i are constants, 

then 

' A-dk^ j dkidk^2Fk,,k.„ (37) 

where Sc is a surface whose boundary is the contour c, and 

_ duo duQ duo duo 
F,,,,_, - (^1^) - (a^lg^)- (38) 

Fki,k-2 is analog of the quantum mechanical Berry curvature. 

The following explicit expression for ^fei,fc_2 then obtained [lOOj by computing 



the eigenvectors of the Hamiltonian ( 32 1 



R , - e^x(e^^fc2 + fc_i) 



The generating function ( 34 1 contains information both about average flux and 



about flux fluctuations. To extract the average current from expressions (36) and 



( 35 1 one should write the cumulant generating function as a power series in the small 



parameter x and retain the linear part, namely 

Sdyn - tS^^lx+0{x^), ^gcom = *X / / dkidk^2Fil\_^+0{x^).m 



Higher order terms in x can reveal information about the higher cumulants of 
stochastic fluxes, while the flrst order terms coincide, up to the ix, with the average 
number of transferred particles. For the process in Fig. [6] such calculations lead to 
the following expression |100j for the mean S ^ P flux per cycle 

.i"^-*^. (42) 

It turns out that the dynamic contribution Jdyn to the current is just the steady state 



current averaged over time. Eqs. (42 1 and (43 1 show that the geometric contribution 
Jgcom to the current has strikingly different properties from the dynamic one. In fact, 
it does not have an analog in a strict steady state situation because it is nonzero only 
if the contour encloses a finite area in the parameter space, i.e. in order to make it 
nonzero, at least two parameters should be time-dependent with a phase shift different 
from or TT. Another interesting property is that this contribution changes sign when 
the direction of motion along the contour is reversed. 

An intuitive explanation of the phenomenon of Jgoom 7^ is illustrated in Fig. [7] 
During an interval of time in which a molecule is bound to the enzyme, the bin of 
Fig. |6]is occupied and the values of ki and k-2 have no effect on the system. If the left 
binding rate ki is higher than the right one k-2 during the upswing of the cycle, then 
ki "shields" growing values of k-2 from having an effect, while fc_2 shields decreasing 
values of ki during the downswing. This leads to a phase-dependent asymmetry which 
is the source of the geometric pump flux. 



It is instructive to compare the relation of the geometric phase ( 36 1 to the value 



given by equation ( 13 1 in the formalism of Landsberg-Ning-Haken, which was discussed 
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k 




suppressed transitions 



Figure 7. Illustration of the shielding mechanism of the SPE. 



in section 3. The pump current (41) itself can alternatively be derived directly from 
the Master Equation for the vector p = {pes,Pe) of probabilities of the enzyme (bin) 
states. These equations have the form 

p = il(x = 0,k)p, iVp = J(p,k), (44) 

where A^p is the average number of product molecules created, and where the current 
J(p,k) is defined by 

J{p,'k) = pssh - PEk-2- (45) 



This set of equations has the form (13 1, namely, probabilities relax to unique steady 
state values at given rate constants k, independently of the additional equation for 
Np. The geometric phase (36 1, however, contains complete information about the 
stochastic evolution, including geometric contributions to higher cumulants, which 
cannot be derived from a set of equations in ( 44 ) . The additional information provided 
by (35) and by (36 1, but not by (44), is sometimes necessary. For example, it is needed 
for a complete description of counting statistics of currents in nanoscale electronic 
circuits, which were measured experimentally in |,105j . The higher cumulants are also 
needed to account for contributions to particle fluxes due to stochastic transitions 
over potential barriers, as studied in |106l 1107] . Thus the full stochastic treatment of 
such processes, beyond the formalism of Eqs. (44 1, is inevitable, and the geometric 
contribution to higher cumulants has important consequences in the theory of such 
effects. 



6. Non-cyclic geometric phase 

The quantum mechanical Berry phase can be extended to noncyclic evolution 
|1081 1109j . Sinitsyn and Nemenman |110j showed that a moment generating function 



of the form ( 33 ) can be partitioned into geometric and dynamic parts even if the 
parameters change along an open circuit. For evolution during time St we have 

Z{x, 6t) = e^'=—(X'**)+'5'^^"(X''^*\ (46) 

where Sdyn — Jq^ dt£o{x: t) is the quasi-stationary part of the generating function and 
where 

S-gcom = / [P(k) - A(k)] • dk, (47) 

J C 
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with 

P = akln(l|uo), A(k) = (7.o|5k^^o). (48) 

where (1| = (1, 1) is the vector with aU unit entries. The noncychc geometric phase 
contribution has no analog in a strict steady state regime. In general, for a non-cyclic 
evolution, the term — A(k) • dk is not gauge invariant, and the term J'^P(k) • dk 
is a necessary correction to make it so. The integral over the additional vector P 
exactly cancels the non-gauge-invariant part of the contour integral of A. The vector 
P introduces the gauge, which can be derived from proper accounting for the effect of 
the averaging over the final states of the bin-system at the end of the evolution. 

Since P is an exact differential, it is important only when looking at an evolution 
along an open path in the parameter space. If the parameter vector k returns to its 



initial value at the end of the evolution, the expression (48 1 becomes equivalent to 



the cyclic geometric phase defined in |100j . The origin of the gauge invariance of the 



expression (47 1 can be traced from the Markovian property of the process. The gauge 



transformation 

Z(x)->Z(x)e«--(x). (49) 

has the physical meaning of the assumption that additional currents, described by 
the cumulant generating function S'prior(x)i have passed through the system before 
the time moment t = Q. In Markovian evolution, the currents counted after t = 
should be independent of the currents counted prior to this moment, which means 



transformation (49) 



that the expression (47), describing the currents after t = 0, is invariant of the gauge 



7. Elimination of fast variables in stochastic processes 

This section is technically more involved than the rest of the review, and can be safely 
omitted on a first reading. It contains a discussion of the method of stochastic path 
integral. This is a powerful technique for investigating stochastic fiuxes in mesoscopic 
interacting systems. The discussion in section 5 reduces the problem of computing the 
counting statistics to that of finding eigenvalues and eigenvectors of a non-Hermitian 
Hamiltonian. This straightforward approach becomes extremely complicated when 
applied to complex systems with a mesoscopically large phase space. In contrast, the 
stochastic path integral technique allows us to derive moment generating functions of 
fluxes even in many-body interacting mesoscopic stochastic systems. We advise the 
reader, who is not familiar with stochastic path integrals, to study look at the articles 
|lllllll2llll3j before reading this section. Sinitsyn and Nemenman |101j demonstrated 
that this technique can be applied to study geometric phases in the evolution of 
driven mesoscopic stochastic systems. In this section we discuss another application 
of geometric phases and the stochastic path integral, namely, to the problem of coarse 
graining stochastic kinetics. 

Berry phases often appear in quantum mechanical applications when one attempts 
to eliminate fast degrees of freedom and reduce a problem to an effective one which 
includes only slow variables. Such an approach is known as the Born-Oppenheimer 
approximation and has been very successful for describing near-equilibrium properties 
of most molecules. According to it, initially one solves a much simpler Schrodinger 
equation for electrons, treating nuclear degrees of freedom as adiabatically slowly 
changing parameters. After this, one assumes that the nuclei move on a single 
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potential-energy surface created by the faster moving electrons. An interesting 
development involving this approach was the observation that the Berry phase, 
acquired by electronic wave function in a potential of slowly moving nuclei, influences 
the dynamics of slow degrees of freedom [2J [inj I114j . 

The evolution equations for moment generating functions in stochastic processes 
are similar to the quantum mechanical Schrodinger equation jlllj . We already 
encountered this analogy in section 5. This mathematical similarity was also used, for 
example, to study counting statistics in electronic transport |112llll31lll5j . to estimate 
over-barrier escape probabilities |106l 1107] and to classify stochastic phase transitions 
|116j . Many of the applications of this approach were restricted to relatively simple 
systems with only a few interacting species because quantum mechanical equations 
are usually no simpler to investigate than the stochastic ones. 

Recently, a stochastic-quantum analogy was proposed to simulate the behavior of 
large stochastic networks of biochemical reactions. In general, these networks involve 
many different chemical species and reaction types. |117j . One of the difficulties 
in studying such networks is their stiffness, i.e. strong time-scale separation of 
various processes in a network. In its application to stochastic processes, the Born- 
Oppenheimer approximation rigorously captures statistical characteristics of chemical 
processes at coarse-grained scales |117j . 

In this section, we present a simple example of how a reduction of a model can 
be achieved and how geometric phases inffuence the evolution of slow variables. For 
this purpose we again consider the Michaelis-Menten type of conversion of S into P 
via creation of a substrate-enzyme complex, which we studied in section 5. Now, 
however, we assume that numbers of substrate and product molecules (TVg and A^p 
respectively) are independent dynamic variables, subject to all the conservation laws 
imposed by the given kinetic scheme. We also assume that the enzyme-substrate 
complex is created from substrate and product molecules at kinetic rates which are 
respectively proportional to the absolute numbers iVs and A'p of these molecules. We 
then have to consider the following four reactions 

(i) forward substrate-enzyme complex formation, S + E SE, with rate kiNs] 

(ii) backward substrate-enzyme complex formation, P + E ^ SE, with rate k^2Np; 

(iii) complex backward decay, SE —^S+E, with rate 

(iv) product emission SE E + P, with rate ^2. 

Since we have only one enzyme molecule but A^g, Ap ^ 1, it takes many identical steps 
for the enzyme molecule to convert a substantial number of substrates into products. 
This creates a time-scale separation, which can be used to reduce the model to an 
effective process 



Our goal is to find the statistical characteristics of the coarse-grained reaction ( [50| ). 
Let Ts^p be the time it takes an enzyme molecule to convert a substrate molecule to 
a product molecule. We choose a time scale dt which is much larger than Ts^p, but 
much smaller than NgTg^p. Suppose that we are looking for the moment generating 
function of the number np of product molecules created during a relatively long time 



S 



P. 



OO 




(51) 
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Here we introduce an additional index C to mark a counting parameter in ( 51 1 in order 
to distinguish it from other variables which will appear in the following calculations. 
As noted in |112l llllj , if one knows the statistical properties of fluxes at time scales 6t 
then the moment generating function at larger time scales can be written in the form 
of a stochastic path integral. We will derive the stochastic path integral representation 



of the generating function in (51 ) 



In Sections 5-6 we already found the full counting statistics of the fluxes in 
Michaelis-Menten model with slowly time dependent parameters. To apply it to our 
model we should redefine kinetic rates as ki kiNs{t) and k-2 k-2Np{t). This 
does not solve our problem completely, because at this stage we do not know the 
explicit time dependence of Ns{t) and Np{t), which we regard as slow but dynamic 
variables. Let us partition the time line into intervals {tm,tm + 5t) of durations 
5t, where — mSt, and let Snp(tm) be the relative change in the number of 
product molecules during these time intervals. We chose St sufficiently small, so 
that {6np{tm)} /Np/s{tjn) ^ 1 while the absolute change is large {Snp{tjn)) ^ 1. 
The probability distributions of the Snp{tm,) are then given by the inverse Fourier 
transforms of the corresponding moment generating functions in Section 6: 

P{6np{Un)) = J ^^^^exp{-ix{tm)Snpit^) + SMM{xitrn),St)).{52) 

Here, Sum — •S'goom + Sdyn is the cumulant generating function of the number of new 
product molecules which were generated during time 6t. Treating A^s/p(^) as slow 



time-dependent parameters, one flnds that Smm is given by Eq. (46 1. 

The moment generating function of the number of product molecules created 
during a large time interval (0,r) is given by the sum over all possible paths in the 
space of dynamic variables Ns(tm), Npitm) and Snp(tm), weighted by the probabilities 



( 52 1 and by delta-functions, which are responsible for conservation of the number of 



molecules, 

Sns = S{Ns{tm+i) - iVs(irn) + Snp{tm)), (53) 

= S{Np{tra+l) - Np{trn) - 5np(i„)). (54) 

We use delta-functions instead of Kronecker symbols because the assumption 
Ng/p, 6np(tm) S> 1 allows to treat iVs/p ^^'^ ^ continuous variables. Using 

T/St 

that np — Snpitm), the moment generating function of this number is a discrete 

rn—l 

path integral 

n /diVs(t„0rf^p(im)rf('5"p(i™))P[5np(i„)]e^'^^^"-(*")5X?s'5]^P-(55) 



We rewrite the delta- functions in ( 52 1 as integrals over oscillating exponents 



53vs/p ^ ^ / dxs/A'tm) exp {ixs/v{t,n)[Ns/p{Un+i) - A^s/p(im) ± 5np{t„^)\) 



and substitute the result into (55 1. After this, integrals over 5np{tm) produce new 
delta- functions, which are easily removed by integration over xitm), leaving us only 
with a path integral over the slow variables Nc^/p{tm) and Xs/p(^m)- Taking a 
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continuous limit, wc have -/Vs/p(t„j+i) — Ng/-p{t„i) — > Ns/p{t)dt, and we can rewrite 
the moment generating function as a path integral involving only slow variables: 

(e*^^"-> = / DNsit) I DNp{t) [ Dxs{t) I Dxp{t)e''^''^-^\ (56) 



where S{xctT) can be partitioned into dynamic and geometric parts 

S{xc,T) = S^y^^xcT) + S^^°'^{xc,T), (57) 



such that 



^geom ^ _ [[A^^dNs + AN.dNp + A^.dxs + A^.dxp], (58) 

J C 

Ax = {uoixs -XP + Xc)\dx\uo{xs ~ Xp + Xc)), (59) 
S^y'^ ^ [ dt [ixsNs + ^XpNp + Hmm{Ns,Np, xs ^ Xp + Xc)], (60) 



where c is the contour of the trajectory in the slow parameter space, x belongs to the 
set {-/Vs, A^p, xs, Xp} ^tnd ^mm plays the role of the effective Hamiltonian 

K - ^"^^2 _^4[7Vgfcifc2(e*(xs-xp+xc) _ 1) +iVpfc_ifc_2(e-*(xs-xp+xc) _ 1)] 

^MM — ^ I 

where K = kiNg + k^2Np + + fc2. This Hamiltonian is different from what one 
would expect if the conversion of 5 into P were a Poisson process, which reflects the 



non-Poisson nature of enzyme mediated fluxes. The geometric part of the action (58 1 
is the result of the pump fluxes. 



The path integral ( 56 1 is a formal solution of the problem of removing of fast 
degrees of freedom: it expresses the moment generating function in terms of only slow 
variables A^s , , Xs , Xp and does not depend on the degrees of freedom of the enzyme. 

Since the averages (iVg) and (A'^p) are assumed large, one can use the saddle 
point solution of the path integral to derive semiclassical equations of motion for slow 
variables. Varying the action results in four coupled differential equations 

^iVs = -^^^^ - ^F^s.NsNs - ^F^sN.Np, (61) 
CXs 

,7Vp = -^^fM^i +,j7^^^^^7Vs + zFx,A.piVp, (62) 
CXp 

iXs = - iFxs.NsXs - iPxsNpXp + iFNs^NpNp, (63) 

iXP = + *^Xs,JVsXS + iFxsNrXP - iFNs,NrNs, (64) 

where -Fa;j_a;2 — i{dAx2/dxi — dAxj^/dx2) and we used thai A^^ depends ouxsjXp via 
the combination (xs~Xp) which leads to the relations -Fxn.x™ ~ F^s.Ns — ~^xp,Ws 
and ^"xs>^p ~ ~Fxp,Np- The boundary conditions can be also influenced by geometric 
phases and should be derived by the method used in |llll 1112] . 



For Xc — there is a solution of equations (64 1 such that Xs = Xp = 0- ^s, 
Np then satisfy coupled equations, which are known to coincide with the mean field 
equations |112j 

iNs = - in^^^NsNs - in^^N^Np ~ ^^^|xs=xp=xc=0: (65) 
iNp = in^^,NsNs + in^sNpNp - ^^^|xs=xp=xc=o, (66) 



CONTENTS 



20 



where ^xi,x2 — ^^i.^g Ixs=xp=xc=o- Explicitly, for our model one can find that 



-fc_2(fc2 + fc_l) 



K3 

(fca + fc-2^p) 

/f3 



(67) 
(68) 



If substrate and product have no other dynamics than the conversion into each other 
via the ES complex, then iVp — — iVg and 



MM I 



dH 



MM 



dxs 



lxs=XP=XC=0 



so, the evolution equation (66 1 for A^p becomes 
(fcifcaA^s - fc-ifc_2A^p) 



Np = 



K 

(fca + fc_i)(fcijVs + fc_2A^p)(fc2 + fc-zA^p) 



(69) 



The first term in ( 69 1 is the usual quasi-steady-state prediction for the substrate- 
product conversion rate, and the second term is a correction due to the geometric 
phase contribution to the effective action. We note again that Eqs. (64 1 contain 



information both about average fluxes and their fluctuations, while the result (69 1 is 
equivalent to the mean-field prediction for the average number of A'p. Substituting 



the solution of ( 64 1 into ( 57 1 , one obtains the full counting statistics of the number 



np of product molecules created. 

Terms resembling the geometric phase corrections in (64) also appear naturally 
in variational approaches to chemical kinetics |118j . Equations of motion, such as 



( 64 1 are known in condensed matter physics, where similar Berry phase terms lead to 
distinct effects, such as the anomalous and the spin Hall effects 13 IB IS] • Generally, 



the geometric phase correction in (69 1 is smaller than the quasi-steady state part. 



However, there are situations when it can be important due to its specific symmetries 



8. Driven limit cycle 

An interesting geometric phase was found by Kagan et al |119j in dissipative systems 
evolving to a limit cycle. In addition to a geometric phase that appears after the 
elimination of quickly decaying modes, they found also a geometric phase which arises 
from the nontrivial topology of the limit cycle itself. Consider the following evolution 
equation 

^^n{<p,^,), (70) 

where ^{(fi) = il(0 -I- 27r) is the instantaneous frequency and /i is a vector of internal 
parameters, which is slowly and periodically time-dependent. Since the evolution is 
periodic, we can regard as a phase. Introducing the new variable 

which is a rescaled version of 0, defined so that 9 evolves at the constant rate 
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when /i is fixed, Kagan et al showed that for adiabatic cychc evolution of the phase 

(73) 



(71 1 becomes the sum of dynamic and geometric parts, 

gcom 



where T is the period of the adiabatic evolution of parameters. 



(T) = / dtoj{^i{t)), 
Jo 



and 



where 



A = 



2Tr 



27r 



(74) 



(75) 



(76) 



One can look at the geometric phase ( [75| from the point of view of the stochastic 
path integral representation, which was discussed in section 7. As in the derivation of 



the stochastic path integral, one can promote the evolution (70 1 to a Hamiltonian flow 

with the Hamiltonian 



by introducing a variable A, which is canonically conjugate to • 
i7(A,0)=Af}(0,M). 



The phase evolution ( 70 ) then follows from the canonical equation 



dt 



dH 
IK' 



(77) 



(78) 



Sinitsyn and Ohkubo [120 ^ showed that, in this Hamiltonian evolution, 0gcom becomes 
a Hannay angle |33j . which is a geometric phase in classical mechanics that is 
responsible for the rotation of the Foucault pendulum, and many other subtle effects. 



9. Thermodynamic constraints and geometric phases 

Geometric approach to classical thermodynamics began with Josiah Willard Gibbs' 
pioneering work, called "Graphical Methods in the Thermodynamics of Fluids" |121j . 
With the development of this point of view, it has become possible to formulate 
classical equilibrium and near-equilibrium thermodynamics in terms of the theory of 
metric spaces and the vector geometry |122j . 

Many applications of geometric phases in stochastic kinetics involve perturbation 
of systems initially in thermodynamic equilibrium. These include the response of 
molecular motors or mesoscopic electronic circuits to periodic evolution of parameters. 
The laws of thermodynamics impose constraints on the kinetic rates which guarantee 
that the Boltzmann distribution at a given temperature describes the equilibrium 
state. These constrains also have important consequences for geometric phases. 

Were it not for geometric phases, a thermodynamic system with adiabatically 
changing parameters would have no average current. When detailed balance conditions 
are imposed on kinetic rates at any moment of time, a strict quasi-steady state 
approximation predicts exactly zero fluxes on average in response to adiabatically 
slow perturbations. Hence, the geometric phase is the only mechanism that can be 
responsible for nonzero currents in such systems. In this section, we discuss several 
examples in support of this conclusion. 
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9.1. Reversible ratchet 

Ratchets are systems, where particles diffuse in a potential, which is periodic both in 
space and time, i.e. V{x,t) — V{x + L,t) — V{x,t + T). The particle distribution 
p(x, t) satisfies the Fokker-Planck equation, which predicts that for a fixed potential 
profile, p{x,t) relaxes to the Boltzmann distribution p{x) — Ce~^'^^^/^'^'^ , where C is 
a normalization constant. An example of a ratchet is shown in Fig. |8] The ratchet 
working in the regime of adiabatically slow evolution of the potential profile is called 
the reversible ratchet because currents in this limit change sign when the potential 
profile changes with time in a reversed order. Thus, the reversible ratchet is a simple 
example of a device working near thermodynamic equilibrium. 

Currents in a discrete version of a reversible ratchet were studied by Markin and 
Astumian |123j . The continuous model |124j was studied by Parrondo, who derived 
the explicit expression for the current of particles in such a system in the limit of 
adiabatically slow changes of the potential. The paradox is that, for adiabatically 
slow changes, one can expect that the particle distribution would have enough time 
to converge to an instantaneous equilibrium distribution, i.e. it is expected to have 
a form p{x,t) f« C(t)e~^^^'*''/'^^"^. Such a varying Boltzmann distribution does not 
predict any current on average in the system at any moment of time, while apparently 
the solution of the problem predicts a nonzero current. 



V(x) V(x) 




Figure 8. Snapshots of a ratchet potential at three stages of its evolution. 



Sinitsyn and Nemenman [lOlj explored this model from the point of view of the 
stochastic path integral representation of the moment generating function of particle 
currents They showed that 

Z{x, T) = A(k).dk+o(x") ^ (79) 

where k is the vector of parameters controlling the shape of V{x\ and c is the 
contour in this parameter space. According to (79 1, the geometric phase is not zero, 
and contributes to the linear term in x of the moment generating function. This 
confirms that the current in an adiabatic reversible ratchet is nonzero and arises 
purely geometrically. It can be totally controlled by choosing a proper contour in the 
space of potential shapes. 

An interesting observation about this effect was made by Shi and Niu |125) , who 
showed that this current can be quantized and that this quantization can be related 
to a Chern number of a Bloch band related to the periodic potential. 
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9.2. Geometric phases and fluctuation- dissipation relations. 

The adiabatic SPE appears when two time-dependent periodic perturbations are 
appHed. From the discussion in section 5, it follows that the average flux of the 
"charge" , pumped by an application of infinitesimal cyclic external fields h b [t] and 
hc{i), is proportional to the area inside the contour of parameter evolution. We also 
showed that the pump current reverses its sign when a system is moving along the 
same contour but in the opposite direction. This situation can be expressed as the 
following law, 

6q = FBcdhB A dhc, (80) 

where 5q is the average of the flux that passes through the system during one cycle of 
the adiabatic periodic evolution, dhs A dhc is the infinitesimal directed area enclosed 
by the contour in the space of control parameters, and Fbc is the proportionality 
coeflicient which, up to an ix-i&ctoT:, coincides with the part of the Berry curvature 
hnear in x- 

According to the Fluctuation-Dissipation Theorem ^126j . some transport 
coeSicients near the point of thermodynamic equihbrium can be expressed in terms 
of correlation functions at the equilibrium point. Relations of this kind tell us a lot 
about the coefficient Fbc EOl 1127] . The quantum version of the adiabatic pump effect 
can be quantified using the Kubo formula |90j . One can derive the analogous result 
for a classical stochastic pump, operating near thermodynamic equilibrium, using a 
classical version of linear response theory |128j . 

Assume that the variables B and C coupled to the fields hs and he in expression 
for the thermodynamic potential are invariant under time reversal. Then at the 
thermodynamic equilibrium, with fixed hs and he, all currents are zero on average, 
that is 

{J{t))hs,hc=^. (81) 
where (. . .)hgh^ denotes the average over the equilibrium distribution at given values 
of hs and he. If we start at equilibrium and increase /i^, he by small amounts 6hB 
and She, then ha{t) — ha{0) +6ha9{t), where a — B,C. According to linear response 
theory, the current at a moment i > is given by 

J{t) = 5JB{t)+SJe{t), (82) 

where 

5Ja,{t)=2i j dt'x'jo.{t-t')5h^, (83) 



"'0 

and Xj„(w) is the response function |126j . Letting x"] ai^) Fourier transform 

of x'j ai'^), we then have 

/|^^?^«>)e-*. (84) 
J zn UJ 

Here, we have used the fact that J and B (resp. C) have different time reversal 
properties so that the static susceptibility |126j is identically zero, i.e. 

^^^ = 0. (85) 
27r Lu 

The classical Fluctuation- Dissipation Theorem |126j states that 

x'M^^Sj^ico), /3 = l/fcBT, (86) 
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where Sja{uj) is the Fourier transform of the correlator 
Sj^{t-t') = {J{t)a{t')), a = B,C 



(87) 



at equilibrium. Substituting (86 1 and (87 1 into (84) and integrating over time, the 



total flux 6q passed due to a perturbation is 
Sq = QjeSHb + QjcShc, 



where 



Q 



JB 



(3 



r 

Jo 



Qjc = /? 



dtSjB{t), 
dtSjcit). 



(89) 



(90) 



Note that both Qjb and Qjc are completely determined by the equilibrium correlation 
functions for nonzero B and C. If we imagine that the adiabatic evolution in the 
space of control parameters consists of small perturbations, as above, then the total 
transferred charge after one cycle is 



Sq ^ <j){QjBdhB + Q.jcdhc} = j 



d/iR A dhc:F, 



(91) 



where c is the contour in the space of control parameters and Fbc is the transport 
coefficient that we have been looking for. According to Stokes' theorem 

dQjc dQjB 



FBcihB,hc) 



dhf 



dh( 



(92) 



Eq. (92 1 shows that the pump transport coefficient can be expressed as the 



circulation, in the space of controlled parameters, of a vector Q whose components 
are the values of the correlators ( 89|90 ) at equilibrium. Such relations indicate that 
the ability of a system to perform as a stochastic pump in response to periodic 
perturbations, can be inferred, in principle, from system properties at thermodynamic 
equilibrium. This can lead to simplifications during numerical or perturbative analysis 
of molecular motor operations, because the equilibrium properties are relatively easy 
to investigate. For example, calculations of free energy landscapes are achievable for 
complex biological molecules such as the kinesin molecular motor |129j . 



9.3. Beyond adiabatic and perturbative limits 

So far, we have only discussed the systems, which are driven adiabatically slowly. 
Quantum mechanical Berry phase can be generalized to the case of non-adiabatic 
evolution |108j . Following this analogy, Ohkubo showed that geometric phases in 
stochastic kinetics also can be considered in the non-adiabatic regime [99] . 

Recently, a number of exact results in the theory of the stochastic pump effect 
were derived which are valid in nonperturbative and nonadiabatic regimes |1301 1131] . 
These results were motivated partly by recent experiments with [2]- and [Bjcatenane 
molecules |133l 11341, 1135] , Such molecules are made of interlocked rings, as shown in 
Fig. [9] ([njcatenane is made of n rings.). By changing external conditions periodically, 
one can modulate the coupling strengths of smaller rings to special sites (stations) 
on the larger ring to force the smaller ones to orbit around the center of the larger 
ring while remaining interlocked with it. Astumian showed in |136] that adiabatic 
modulation of couplings to stations cannot be used to select a preferred mean 
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PIcatenane ^ [SJcatenane 




(a) 

Figure 9. Topology and metastable states of (a) [2]catenane and (b) [3]catenane 
molecules. Smaller rings are capable to perform directed rotational motion around 
the larger ring in response to external periodic driving. In [3]catenanes, unlike 
[2]catenanes, directed motion can be achieved even when only coupling strengths 
of smaller rings to the three stations on the larger ring are controlled. 

orientation (clockwise or counterclockwise) of the orbit of the small ring in [2]catenane 
about the large ring, but can be used to select a preferred mean orientation for the 
orbit of the pair of small rings around the large ring in a [3]catenane in Fig. [9j 

Any finite Markov chain can be represented as a graph. In such a graph, vertices 
correspond to discrete states of a system and links correspond to allowed transitions. 
We say that kinetic rates kji of transitions from the state i to the state j satisfy the 
detailed balance condition if they can be parametrized by parameters Ei (called well 
depths) and Wij — Wji (called barrier heights) such that kji — kexp[Ei — Wij]. The 
detailed balance conditions guarantee that if all parameters are time-independent then 
the state probability vector relaxes to a Boltzmann distribution. Every vertex in a 
graph, representing a Markov chain, is associated with parameter Ei and every link 
corresponds to some finite Wij. 

Rahav, Horowitz and Jarzynski [130] showed that the result observed in catenane 
molecules is a consequence of a much more general No-Pumping Theorem. They 
showed that for a periodic non-adiabatic driving protocol, the average flux Q, passed 
through any link i — j of a graph representing a finite Markov chain, can be written 
as a sum of geometric and dynamic parts, i.e. 

[ dtJdyn{t)+ (f A-dp. (93) 



In the first term in ( 93 1 , T is the driving period. The second term in ( 93 1 is geometrical 



and depends only on the path c in the space of values of the state probability vector 



p. The representation (93 1 is not an explicit solution because the evolution of the 
probability vector p is not assumed to be known. However, the authors of |130j 
showed that when detailed balance conditions are imposed, even on time-dependent 



kinetic rates, the dynamic part in (93 1 becomes identically zero. Thus, even for rapid 
variation of the control parameters, the flux is purely geometrical. Moreover, they 
showed that the connection A is independent of Ei. As a consequence, if some well 
depths Ei are varied, while the Wij remain fixed, and if the probability vector returns 
to the initial values at the end of the evolution, the geometric term becomes also zero 
because A • dp = A • c?p = 0. 

Chernyak and Sinitsyn |131j derived and proved the Pumping-Restriction 
Theorem, which includes the No-Pumping Theorem of [130] as a special case. The 
Pumping-Restriction Theorem makes two assertions. The first assertion tells us that 
not all pumped currents, i.e. time-averaged currents induced by a cyclic evolution of 
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Figure 10. A graph with a tree-Uke topology. 

parameters, are independent. More precisely, pump currents through various links can 
be considered as vectors in a vector space whose dimension is equal to the maximum 
number of time-dependent barriers Wij such that removing the links, corresponding 
to these barriers, does not break the graph into disjoint components. A trivial 
consequence of this theorem is that the pump current through any link on a tree- 
like graph, such as the one in Fig. |10| is exactly zero. Indeed, removing any link 
from a tree (not touching the vertices) breaks the graph into disjoint components, and 
according to the Pumping-Restriction Theorem, the pump current on such a graph 
should be zero. 

The result for a tree graph is expected because, for periodic evolution of 
parameters, the flux through any link on such a graph should eventually return through 
the same link moving in the opposite direction since initial and final state probability 
vectors coincide. Hence, the integrated current must be zero. The Pumping- 
Restriction Theorem leads also to many less obvious predictions. For example, in 



the graph in Fig. 11 'a), one can, by perturbing periodically well depths Ei and also 
only the barriers related to links 2 — 3 and 3 — 4, induce a nonzero pump current, 
because removing any one of the links 2 — 3 or 3 — 4 does not break the graph into 



disjoint components, as it is shown in Fig. 11 'b). According to the theorem, however, 
a pump current through any link in Fig. [ll^ a) will then be proportional to the pump 
current through the link 2 — 3 with a constant proportionality coefficient, which is 
independent of the driving protocol, because removing both links 2 — 3 and 3 — 4 we 



would break the graph into disjoint parts, as it is shown in Fig. 11 'c). Hence the 
dimension of the pump current space in this case is only 1. The Pumping-Restriction 
Theorem also predicts that an arbitrary periodic driving of parameters on the links 
1 — 2 and 4 — 5 in Fig. [TT] alone cannot induce the pump effect, because removing any 
of those links would break the graph. That should suffice to explain and illustrate the 
first assertion of the Pumping-Restriction Theorem. As for the second assertion of the 
theorem, it states that if pump currents are allowed, and if there are restrictions on 
their values predicted by the first part of the theorem, then these restrictions do not 
depend on parameters Ei. 

The existence of exact results, such as the No-Pumping and the Pumping- 
Restriction Theorems, tells us that there are strong constraints which must be satisfied 
by control parameters in order to induce a directed motion of a nanoscale device. At 
this stage it is unclear whether these theorems can be extended to include current 
fluctuations, or whether the Pumping-Restriction Theorem can be related to other 
exact results in non-equilibrium thermodynamics, such as the Jarzynski equality 
|137j . or the invariant quantities in a shear flow found in [132] . We note that a 
number of fluctuation theorems have been found for applications to ratchet systems 
and molecular motors |138} 1139] I140|,[T4T|I142| [143] . but their connections to geometric 
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Figure 11. (a) A graph representing a six-state Markov chain, (b) Removing the 
hnk 2 — 3 alone does not break the graph into disjoint components, (c) Removing 
hnks 2 — 3 and 3 — 4 breaks the graph. 



phases are unknown. 

10. Geometric phases and molecular motors 

Applications of geometric phases in mathematical robotics are based on the same 
geometric structure as the one discussed by Shapire and Wilczek to describe the 
locomotion of living cells [TlJ |72]. As in the case of living organisms, the internal 
motions of robots are confined to a particular region as the robot performs its tasks. 
Nevertheless, as the robot interacts with its environment, periodic changes in the 
internal control variables can lead to nonperiodic effects on the robot position or on 
its surroundings. The reader is referred to [151 11441 1145] for an introduction to the 
geometric theory of robotic motion and for references to its extensive literature. In 
this section we demonstrate how geometric phases in stochastic kinetics appear in the 
control theory of the molecular machines. 

Many biological molecules resemble motors, and sometimes operate according to 
principles similar to those which govern the macroscopic machines used by humans. 
Molecular motors are ubiquitous in living organisms. They are employed, for example, 
for transport, for injecting viruses into living cells, for unzipping the DNA, and for 
storing energy |146l 1147] . 

Experimental progress in the synthesis and observation of molecular motors has 
been remarkable. The reviews |148LI149] describe many recently synthesized molecules 
such as rotaxanes and catenanes, which are able to perform prescribed mechanical 
movements in response to external stimulus. Moreover, the experimental techniques 
for observing molecular motion have reached a level where discrete steps in a molecular 
motor operation can be observed |1501 1151] . It has become feasible to measure noise 
and even the tails of the probability distributions of reaction events |150l 11521 1153] . 

Better understanding of the working principles of nanoscale machines will make 
it possible to rebuild them to perform specialized tasks. In living cells, the molecular 
motor FpFi-ATPasc can convert the energy of an H+ gradient into chemical energy 
stored in ATP. This natural molecular motor was rebuilt recently by modifying its 
Fi-subunit and was used to store the work done by an external magnetic field as 
chemical energy |154j . Another artificial modification of this molecular motor, shown 



in Fig. 12 was used in |155] to demonstrate the rotation of a metallic bar, powered 
by ATP. 

At the molecular level, fluctuating forces are considerably stronger than typical 
external fields. Unlike macroscopic machines, molecular motors such as FpFi-ATPase 
absorb chemical energy in discrete portions and randomly. This leads to the so 
called shot noise in their operations. Molecular motors are also affected by strong 
thermal fluctuations. These fluctuations are not merely a theoretical complication. 
For example, vesicle transport via the "hitchhiking" mechanism, proposed in |156| 
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Figure 12. Fi-subunit of the natural molecular motor FpFi-ATPase with 
attached magnetic needle in external magnetic field B. 



depends on stochasticity in an essential way. Single molecule experiments show that 
noise measurements can provide important information about molecular structure 
|150| which can, in turn, be employed to uncover details of the working cycle of a 
molecular motor. Thus, the theory of molecular motor operations must take stochastic 
effects into account. 

Much effort has been devoted to modeling the thermodynamics of molecular 
motors using the models of stochastic pumps and ratchets [531 HSl HSl HZl 1157] . This 
work has been reviewed in |158l 11591 11601 1161] . In contrast, appreciation of the role 
of geometric phases in molecular motor operations is relatively recent and is still in 
an early stage of development [Ml [Ml [Ml [Ml (Ml [Ml [M| • 

To illustrate that role, we consider a model inspired by the structure shown in 
Fig. [12[ where the metallic bar is magnetic and the whole structure is placed in a 
rotating magnetic field. The molecule has an approximate 3-fold symmetry (except for 
its rotating 7-subunit). If the magnetic coupling to the needle is weaker than the size 
of the potential barrier W between any pair of metastable states, the kinetics can be 
minimally described by a 3-state model with some stochastic transition rates between 
any pair of neighboring states, as shown in Fig. [3] Near equilibrium, rotational steps 
of the 7-subunit in both directions were observed experimentally |165] . Due to the 
magnetic needle, it is possible to control the relative energies of the 3 states and of the 
potential barriers, which separate them, by applying an external rotating magnetic 
field. We will be interested in the number of full rotations of the needle, and hence 
of the 7-subunit attached to it, as it is driven in a neighborhood of thermodynamic 
equilibrium. 

One can parametrize kinetic rates of an arbitrary Markov chain with detailed 
balance conditions in the following way, using the terminology "well-depth" and 
"barrier height" which was introduced in section 9.3: for sites i and j, the transition 
rate from j to i is kij = ke^^~^'^ , where Ej is the well-depth j, and Wij = Wji is the 
barrier height between sites i and j. Here, the energy scale is k^T — 1, where T is 
temperature and fc^ is the Boltzmann constant. The parameter fc is a constant rate 
coefficient which sets the time scale and depends on the properties of the solution. 
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i.e. on environment of the molecular motor. Imitating the procedure that was used in 
section 5, one finds that the moment generating function of the number of full rotations 
in the clockwise direction (counting counterclockwise rotations with a negative sign) 



is again given by Eq. ( 33 1 , but with the new Hamiltonian that reads 

/ -(fc2i + fcai) fci2e-'x/3 fci3e*^/3 \ 
H{x) - A^aie^'^/^ -(fega + fci2) fcage-^^/^ . (94) 

V ^316-^^^/3 fc32e'x/3 _(fc^3 + fc23) y 

The magnetic field modulates the parameters Ei and Wij, and hence k^i. The 3- 
fold symmetry of the molecule can be taken into account by assuming the following 
dependence of the parameters Ei on the components and By of the magnetic field: 

El = by, 

-E'2 = &a; cos(7r/6) — 6y cos(7r/3), (95) 
-E3 — — cos(7r/6) — 6j, cos(7r/3), 

where b^/y = — i?j,/j,|M|, and M is the magnetization vector of the needle. One can 



derive ( 95 1 by assuming that the first metastable state corresponds to the magnetic bar 
pointing along y-axes and the other two are generated by a rotation of the needle by 
angles 27r/3 and 47r/3. For the magnetization energy e, we use units where e = — B • M. 
Suppose that the maxima of the potential barriers are shifted from the potential well 
minima by an angle (j). Thus a reasonable assumption for the dependence of the barrier 
heights on the magnetic field would be 

W12 = W + b^ sin(0) + by cos(0), 

W23 = W + 5^ cos(7r/6 + <j)) ~ by cos(7r/3 - </>), (96) 
Wi3 = W -b^ cos(7r/6 - 0) - 6^ cos(7r/3 + ^). 

According to the procedures of |100j . which have been discussed in section 5, the 
moment generating function of the number of full rotations of the needle is determined 



by the eigenvalue with the lowest real part and corresponding eigenvectors of (94). 
While it is not convenient to study the exact expressions for eigenvectors of a 3 x 3 
matrix, it is not hard to derive the lowest cumulants of the rotation numbers by 



treating the counting parameter x perturbatively, as in |166j . As in the example 
of the reversible ratchet, the principle of detailed balance imposes constraints which 
imply that, on average, the needle rotation becomes a purely geometric phase effect 
and that the average number of needle rotations per cycle can be expressed as an 
integral over a surface Sc whose boundary is the contour c in the {bx,by) parameter 
space, namely 

(n) = J dbydb,F{bx,by). (97) 

The "Berry curvature" F{bx,by) determines the sensitivity of the system to external 
driving forces. Regions with larger values of the function F{bx,by) correspond to 
parameter values at which system makes more rotations, on average, in response to 
periodic parameter variations. For a symmetric barrier configuration (^ — 7r/3), the 
expression for F{bx,by) is particularly simple, namely 

F{bx, by) = 3 . (98) 
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Figure 13. The contour plot of the "Berry curvature" F(bx,by) from Eq. (jOTjl, 
as a function of control parameters bx and by . Brighter areas correspond to larger 
values of F{bx, by), and dark area corresponds to regions where F{bx, by) ~ 0. 



Positivity of the Berry curvature in Fig. [13] means that the maximum number of 
rotations per one cycle is achieved for the contour that encloses the whole bright 



area in Fig. 13 from a very large distance in the parameter space. For any such 



a large contour, the result of the integration (97 1 of the Berry curvature remains 
approximately the same and can be estimated by setting the limits of the integration 
in (97 1 to infinities, which gives 

dbydb,F{b,,by) ^ 1. (99) 



The result shows that the system in Fig. |12| makes, on average, at most one net rotation 
for every rotation of the magnetic field along a closed non-intersecting contour. This 
result does not require that the coupling to the magnetic field be the largest energy 
scale in the model. In our calculations we always assumed that W > b^/y, in order 
to use a 3-state approximation. The resulting quantization happens only on average, 
and the needle is allowed to make many stochastic steps before the rotation of the 
magnetic field is complete. 

By comparing the number of rotations of the structure with the absolute value of 
the field, one can determine the function F{bx^ by) experimentally. Fig. |13| shows that 
F{bx, by) has the same 3-fold symmetry as the kinetic model in Fig. [3] Its values can 
therefore reveal details of the internal molecular structure and of possible components 
in the effective kinetic model. Interestingly, the theory predicts that the geometric 
phase and the function in Fig. [13] are independent of the parameter k and of the size 
of an unperturbed barrier W. This means, in particular, that the function F(bx,by) 
can be robust against variations of the viscosity of the solution. This prediction is 
valid as long as the magnetic field rotation is adiabatically slow and the system always 
remains close to thermodynamic equilibrium. Thus we predict a universality of the 
motor response, in a sense that it does not depend on the solution viscosity, which can 
be tested experimentally. If the molecular motor is subject to additional forces, such 
as a proton gradient, which drive it beyond the regime of approximate thermodynamic 
equilibrium, this universality may no longer hold. 
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11. Discussion 

The analogy between the evolution of generating functions in stochastic processes 
and the evolution of quantum mechanical wave functions allows to consider complex 
stochastic processes using the framework of quantum mechanics. In this review we 
discussed how, due to this analogy, quantum mechanical Berry phases appear to have 
counterparts in classical stochastic processes. The quantum pump effect, whose origin 
can be attributed to a Berry phase, has a stochastic counterpart with a similar 
geometric phase interpretation. We also showed that, as in quantum mechanics, 
geometric phases can influence the motion of coarse-grained degrees of freedom in 
stochastic processes after elimination of fast variables. This similarity raises questions 
about the possibility of further analogies. 

Berry phases are responsible for a number of important effects in solid state 
physics, such as the quantum Hall effect. Although it is unclear whether or not 
similar effects can be discovered in classical dissipative systems, several features of 
the SPE have quantum mechanical counterparts. We showed in section 10 that the 
SPE can be quantized, i.e. the number of system rotations per cycle can be some 
integer. Similar quantization has been considered as a special feature of the quantum 
pump |167j and the quantum Hall effect [19]. There are also examples of fractionally- 
quantized responses of stochastic systems f l331 1136] . Usually quantization is achieved 
in the limit of the maximum efficiency of the stochastic system response along a cycle 
in the space of control parameters. While such limits are easy to find in simple models, 
little is known about how to determine them in the general case. One possibility was 
proposed by Shi and Niu in |125j . Examining the diffusion in a periodic potential they 
related the quantization of the stochastic ratchet current to a Chern number. It is 
possible that this observation can be generalized within the Olson-Ao description of 
the Bloch-Peierls-Berry dynamics [169'. Another type of quantization was found in 
dissipative transport of a particle on a periodic lattice with non-Hermitian evolution 

CM]. 

Certainly, there are important differences between quantum and classical systems. 
The quantum Hall effect and the quantum theory of polarization require the existence 
of the Fermi sea, and thus are intrinsically many-body effects which rely on the 
Pauli principle for a multi-particle fermionic wave function. To some extent the Pauli 
principle can be mimicked in stochastic processes by means of exclusion interactions, 
as in the theory of the shot noise in electronic circuits |103j . The model we discuss 
in section 5, provides a simple example of a geometric phase effect which is induced 
by exclusion interactions. Even in simple systems, interactions lead to important 
effects, such as violation of the assumptions of the No-Pumping Theorem [1301 1136] . 
It is therefore important to explore geometric phases in strongly interacting many- 
body stochastic systems, such as in reaction-diffusion models and multistate exclusion 
processes llTOIIlTf . In quantum field theories. Berry phases are responsible for chiral 
anomalies |172j . Such anomalies play an important role in the quantum pump effect 
and in the theory of the quantum Hall effect |173j . It would be interesting to know 
whether the quantum-statistical analogies discussed in this review can be used to find 
stochastic phenomena analogous to chiral anomalies. 

Conversely, quantum theory can benefit from the analogy with stochastic kinetics. 
For example, one can explore the possibility of a quantum mechanical analog of 
the Pumping-Rcstriction Theorem. One can also consider geometric phases in the 
evolution of the counting statistics in quantum mechanical systems |174j . Fractional 
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quantization of pumping in stochastic systems, such as in [3]catenanes |133j . may shed 
new hght on the nature of quasiparticles in the fractional quantum Hall effect. 

One of the goals of this review is to emphasize that geometric phases can play 
an important role in the theory of molecular motors. We showed that calculations 
of geometric phases are important in designing molecular motors and specifying their 
operations. Such calculations are not based on direct numerical solutions of differential 
equations with explicitly time-dependent parameters. Instead, by applying the theory 
of geometric phases it is possible to understand molecular motor operations using 
knowledge of only the energy landscape of a molecule as function of control parameters. 
The theory also suggests new response coefficients for experimental investigation. 
Measurements of the Berry curvature should provide new insight into the structure of 
motor molecules. 

Molecular machines, driven by external time-dependent forces, obey simple 
universal laws, which remain to be explored and whose existence is indicated by the 
discovery of geometric phases in stochastic kinetics and exact universal results such as 
Pumping-Restriction Theorems and Fluctuation Theorems. In the future, the science 
of controlled mesoscopic systems will be transformed by the investigation of these 
laws. 
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